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Abstract: 

We calculate the mean number of metastable states of an Ising ferromagnet on random 
thin graphs of fixed connectivity c. We find, as for mean field spin glasses that this mean 
increases exponentially with the number of sites, and is the same as that calculated 
for the ±J spin glass on the same graphs. An annealed calculation of the number 
(Nms{E)) of metastable states of energy E is carried out. For small c, an analytic 
result is obtained. The result is compared with the one obtained for spin glasses in 
order to discuss the role played by loops on thin graphs and hence the effect of real 
frustration on the distribution of metastable states. 
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1 Introduction 



The nature of the spin glass phase is still a subject which is widely debated. Two 
possible scenarios have been proposed, one inspired from mean field models which 
shows that in the spin glass phase one has an extensive number of pure states, this 
phenomenon appears as replica symmetry breaking (RSB) in mean field models [l], |2| . 
The other scenario is the droplet picture where there is a non extensive number of pure 
states as in a ferromagnet ||, |j. If the RSB image is correct then an extensive number 
of pure states must also show up in the number of metastable states in a system, 
thought the relevance of metastable states or inherent states, as they are referred to in 
the literature on glassy systems, to pure states is not obvious or even justified || ||]. 
There has been a considerable amount of effort to analyze the metastable states in mean 
field model J7], || ||, [10], [IT], [L2|] and also the number of solutions of the TAP mean field 
equations for this model (the generalization of metastable states to finite temperature) 



|T3| , |14| . Calculations on the Sherrington Kirkpartick (SK) totally connected spin glass 
demonstrate the existence of an exponentially large (in terms of the number of spins 
N) number of metastable states and the continuing existence of a macroscopic entropy 
of metastable states even at arbitrarily high vales of a uniform magnetic field (in 
agreement with the divergence of the Almeida Thouless line at zero temperature) |TJ| . 
This latter fact is clearly a pathology of the totally connected geometry of the SK model. 
In the SK model each spin is connected to all the other spins and the existence of the 
thermodynamic limit is ensured by scaling the couplings by a factor l/y/N in the case 
of symmetric distributions. This scaling of the interaction strength with the system size 
is clearly undesirable when one wishes to make a connection with the finite dimensional 
analogue. Corrections to order 1/c, where c is the lattice connectivity, about mean field 
theory f7j seem to suggest an enhancement of the number of metastable states when the 
dimension is reduced. Analytic studies of finite dimensional spin glasses are extremely 
difficult given that the complexity of the starting point of any perturbative analysis, 
that is to say the Parisi replica symmetry breaking scheme. 

Recently there has been renewed interest in spin glasses on random graphs of finite 
connectivity AXEL [171 [TR [H| EQ], the advantage with such systems is that while a mean 



field analysis is still possible, these systems mimic the finite connectivity of real finite 
dimensional spin glasses. It has been shown that the replica symmetric solution in such 
systems is not stable |2TJ. Unfortunately no exact treatment of the RSB solution has 
been achieved, there are however approximate treatments which yield promising results 
fT7| , . Additionally one may carry out a perturbative replica symmetry breaking in 
some cases, such as close to the critical temperature or in the limit of large connectivity 
p3| , [24}j . Interestingly it can be shown that the replica symmetric solution on thin 
graphs (random graphs where each site has a fixed connectivity c) is equivalent to 
the solution for a spin glass on a Cayley tree with branching ratio c — 1 (see []T7j and 
references therein), that is to say the graph one would obtain roughly if one eliminated 
all the loops present in the corresponding random thin graph. It is well known that the 
fraction of loops in such graphs goes as ln(iV) where N is the number of sites. Therefore 
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one can see, that despite the scarcity of such loops, their effect is extremely important 
and that they make a replica symmetric system become RSB. Of course it is only 
through loops that one can have real frustration [25], without loops one may construct 
local gauge transformations that make the system equivalent to a ferromagnetic one. 
In a recent paper |2l5 |, the number average metastable states of ±J (where each bond 
is taken to be ±J with probability 1/2) spin glasses on random thin graphs has been 
calculated. At zero temperature the number of metastable states is defined to be 
the number of spin configurations stable to single spin flips. It was shown that this 
number decreases as the connectivity is increased and in the limit c — > oo the result 
for the Sherrington Kirkpatrick mean field spin glass was recovered. In this paper we 
consider the problem of purely ferromagnetic systems on such graphs. Here there is 
clearly no real frustration even with loops. We find that the average total number 
of such metastable states on the ferromagnet is equal to average total number on 
the corresponding ±J spin glass. However one finds that when one calculates the 
average number of metastable states of fixed energy E, N MS (E) there exists a critical 
energy E* such that (N^ S (E)) = (N^ S (E)) for E > E*. (here the superscripts F 
and SG denote ferromagnet and spin glass respectively and (■) denotes the disorder 
average) but (Nfp s {E)) < (N^ IS (E)) for E < E*. Hence the rather surprising result 
that at lower energies the ferromagnet has more metastable states than the spin glass. 
We show that this difference is due to the effect of loops and moreover that E* is 
the energy at which the metastable states of the ferromagnetic system acquire a non 
zero magnetisation. In addition we show that for E > E*, In (^(N M ^(E))^j /N = 

In {{N[ IS (E))) /N is a concave function of E whilst for E < E*, In ((N^ G S (E)}^ /N 

remains concave but In y(N^j S (E)) \ /N becomes convex. Thus suggesting that the 
concavity of In ((Nms(E))) /N at low energies and and hence temperature, may be an 
indication of replica symmetry breaking. 



2 Analysis 

The model we shall consider has the Hamiltonian 

H = -~ 53 JijUijSiSj (1) 

where the are Ising spins, is equal to one if the sites % and j are connected. In the 
spin glass case considered in [pi the are taken from a binary distribution where = 
— 1 with probability half and J^- = 1 with probability half. In the ferromagnetic case 
we consider here one has Jij = 1. A metastable state is defined to be a configuration 
where if one changes the sign of any given spin the energy does not decrease, for the 
purposes of this paper we shall include the marginal, case where the energy does not 
change, as being metastable. With this definition number of metastable states is given 
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by E 0, 1 

N MS = Tr[[d[^rj tl n tl S l S J \ (2) 




The fact that we include the marginal case implies that here 6(x) the Heaviside step 
function is taken such that 8(0) = 1. In the spin glass case one may exploit the parity 
of the distribution of the by making a gauge transformation Jjj — > JijSiSj to obtain 

(NMs) = 2 N (U9[^J ij n ij )) (3) 

i=i / 

However this is not possible in the ferromagnetic case, and thus renders the ferromag- 
netic problem more difficult than the spin glass. 



We shall use the method of construction of the thin graphs used in ||26|| . Another 
method to generate these graphs by considering planar Feynman diagrams was used 
in |2(| [18|, The random graphs are constructed as follows: any two points are 

connected with probability p/N. Hence riij is equal to one with probability p/N and 
zero with probability 1 — Here p is some arbitrary number of order one and we 
shall see that the results one obtains are independent of the choice of p. If we denote 
the average on a random graph (with a specified value of p) by (-) p then the induced 
average over the subset of thin graphs of connectivity c is given by 

(F) = — (4) 

^ 1 M{N,c,p) y 1 

where 

N 

M(N,c,p) = (l[5 E ^ n ^ c ) p (5) 

i=l 

is the average number of thin graphs of connectivity c generated by the random graph 
ensemble for a given p. Here, as opposed to the spin glass case, this is the only disorder 
average. It was shown in |26| that 



ln(M(iV, c, p)/N = ^ (In c - lnp - 1) - ln(c!) - - 



With this averaging we therefore find that 



F _ D(N,c,p) 

W"s>- M(N,c, P ) {b) 



where 

N 



D(N, c,p) = (J] e MT J<,.ny ] S E ^ nij!C ) p (7) 

*=1 
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To compute D(N, c,p) we introduce Fourier representations of the Heaviside and Kro- 
nnecker delta functions to obtain: 

D(N,c,p) = (J dXi ^^ Tra.c^' frc+xiVj)-? n u (a.+a.+^s,)^ 



(-47T 2 ) 



d\i dxi dy irT , i^+^Vi) n, 



(-4vr 2 > 

_ r dKdxjdyj E {XiC+Xiyi) 

~ J f_ 4ff¥ L ** e ex P 



£_ _i_ _ \ e ~ A i~ A j 2 — 

2 2N 4?. 



as N goes to infinity. Here the integration ranges are A G [0, 27r], x G [0, oo] and 
y G [—00,00]. Now, we use the useful identity: 



+ e 



-A— A' 



-A-A' 



,y 



>y 



^cosh(-) cosh(-) + sinh(-) sinh(-) J 
SS' ( cosh(|) sinh(^) + cosh(^) sinh(^) 



(8) 



which allows us to write the term into brackets as 

exp [•••] = 

Np p 



exp 



^(iX^oshtf)) + ^(l>- S i„h(f) 

+ J, (iX^, cosh(f )) S,e-».'sinh(|; 

One can now decouple the sums by introducing two real Hubbard-Stratonovich fields 
u and v and a complex field z giving 

D(N,c,p) = J dzdzdudve- N ^ + ^ +lzl ' 2) 

x 1 Trg / rfArfxrfye Ac+ ^ + ^ e_A [( M+s '^ cosh (I)+( ,;+5z ) sinh (|)] 
.—An 2 J 

where the trace above is over a single spin. By using the following identity: 



we get: 



1 Tr / d\dxdve Xc+yx+y/f;e ~ X [( M + S ^) c ° sh (f )+(*>+^)sinh(f )] 
-4tt 2 7 y 
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— , Tr 5 / dxdy Jp (u + Sz) cosh(^) + (v + Sz) sinh(^ 
2nr c! J L 2 2 

J dx dy ^ e 



pi 
2iirc\ 



s±i 



v _y 



e 2 e 2 

— (u + Sz + f + Sz) H — — (w + Sz — f — Sz) 

_ _ 



, . . u + z + v + z^ u - z + v - z u + z - v - z 
Now, introducing A = , B = and G = , this 

JLi Zi 

term becomes 
where: 

/(*)= E ( 10 ) 

f <n<c \ fl ) 

On calculating the ratio D(N, c, p)/M(N, c, p) we find, as it should, that the dependence 
on p disappears and one obtains via a saddle point calculation in the large N limit 



In ((Ks)) /N = max AB , c S*(A, B, C) (11) 

where 

S*(A,B,C) = -^-^ - CC + \n (C C J(^) +^/(|)) - f(Mc) - 1) (12) 

A B C 

We again change variables: it = — , v = = and t = — , solving the saddle point equation 
for C and substituting in this solution yields 



In {(N^s)) /N = max u ,„, ( S F (M, v, t) (13) 

where 

S F (u, v, t) = -°- In (u 2 + tV + 2t) + In (/(u) + t c f(v)) . (14) 

We notice Sp(u,v,t) is invariant under the transformations u — *> t>, v — > u, t — > ~. 
There is consequently a saddle point solution at the fixed point of this transformation 
u = v with t = 1, this leads to exactly the saddle point obtained for spin glasses where 

Ssg(u) = - C - ln(l + u 2 ) + Hf{u)) + (1 - |) In 2, (15) 

In general one must solve the remaining saddle point equations numerically. For the 
case c = 1 (dimers) and c = 2, one dimensional chains the solution is identical to that 
for the spin glass case |26fl . To continue we will focus on the c = 3 case, which can also 
be computed analytically. In this case, the stationarity conditions are: 
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u + 2 = t(v + 2) 
t = 
u 2 = t 3 v 2 

v + 2 

where = — These equations imply the following: 



[/ = M + 2 

V = w + 2 

[/ = tp(V) 

V = <p(U), 

u 2 

where (p(U) = — — . This implies that U and V are solutions of U = ip o ip(U), 

(U — 2) 

which has two kind of solutions: 

• U = V = (f(U)i which is the one found for the spin-glass. 

1 8 

The first solution gives for the action the value - In-, whereas the spin-glass one is 

\ ln(|). This shows that for c = 3, the logarithm of the average number of metastable 
states for the Ising model on random thin graphs is the same as the one obtained for 
the ±1 spin-glass on the same graphs with an annealed calculation. Carrying out a 
numerical investigation for c > 3 we find that (N^ s ) = (N^ s ). One may understand 
this result heuristically if one considers that {N^ s ) and (N§^) are dominated by the 
metastable states at an energy where the effect of loops is not important, then one may 
write 

(Nms) = (^fle fenvSiS,)) (16) 
»=i ) 



N 



and 

(^) = (Tr J!3 n^(E^I) (17) 
i=i \j& J 

where Trj.. indicates a trace over independent dynamical variables Jij taking the values 
±1 on the bonds of the graph and the Jy. In the ferromagnetic case one may take 
the variables SiSj to be independent variables taking the values ±1 if one neglects 
the effects of loops which would introduce correlations between these bond variables. 
Hence one expects that (N^ s ) = (N^ s ) if loops are not important at the energy level 
where the metastable states are concentrated. In the case c = 1 and c = 2 it is clear 
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that loops cannot play a thermodynamically important role. One can make nonlocal 
gauge transformations that in fact demonstrate that \n(N^ s )/N = ha.(N^ s )/N with 
probability 1 - in the thermodynamic limit the two models are equivalent up to a gauge 
transformation. We confirm this picture in the next section. 



3 Metastable states of fixed energy 

Here we define the average number of metastable states of fixed energy NE 

N MS (E) =Ttf[e [Y^^n^sA 5{H-NE). (18) 
i=i \j& J 

To achieve this, we need to introduce a Lagrange multiplier a to fix the energy and 
carry out a calculation almost identical to that of the previous section. 
We find 

— * — — = m&x U:V:t>a S{u,v,t,a;E) (19) 

where 



S(u, v, t, a; E) = ~ \n(u 2 + t 2 v 2 + 2t) + In (f(ue~ a ) + t c f(ve~ a )) +a(^-E) 

At the saddle-point, the energy is : 

„ c 2t - u 2 - t 2 v 2 
E 



2 2t + u 2 + t 2 v 2 ' 
We call x = — , so we have the relation: 

u 2 + t 2 v 2 1 — X 
2t ~ 1 + x' 



(20) 



For c = 2, the result is the same as for the spin-glass as expected. Let us show briefly 
how to recover this with a transfer matrix method on the one dimensional model. 
First, one makes the gauge transformation SiSi + \ — > Si. One introduces a Lagrange 
multiplier a to fix the energy and we get: 

N MS {E) =max Q Tr.M^, 

where 

M a (S, S') = e aE+a§J ^ 9(S + S'). 
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So M^MgOgD = maxa In (/!„), where /j, a is the largest eigenvalue of Ai a . We find: 



e a + y/e 2a + 4 

A*« = g 

So at the maximum: a* = In ^~^ 2 and we recover the result of [26 for the c = 2 spin 
glass ±J on a thin graph 

HNMsm = l-E 1-E _l±l ln l±l + E h( _ 2B)i 
AT 2 v 2 ; 2 2 v ; ' 

confirming the above assertion. For generic values of the local connectivity, the saddle- 
point equations can be solved numerically. In fig. ([I]), we have plotted the result for 
c = 4. The curve corresponding to c = 3 has also been calculated numerically and 
agrees perfectly with the following calculation. Let us focus onthe c = 3 case. For 
convenience, we introduce new variables: 



U = ue~ a + 2 (21) 
V = ve~ a + 2 (22) 



e -2a 



2 

In this case, the stationarity conditions lead to: 



(23) 



U = tV (24) 
ve~ a + 2 u 2 



t 



v 2 ue~ a + 2 



U 2 e- 2a 

and the function ip is now % ■ The equation <p o tp(U) = U is of degree four and 

(U — 2) 

can be factorised by the second degree equation <p{U) = U. There are two solutions 
with U ^ V obeying 

- 2 - a (25) 

UV - 4 



Moreover, by using (|2H|) in (p0| ) one obtains 

u 2 + t 2 v 2 _ U + V _ 1 - x 
2t ~ 2 ~ T+x 

yielding two different values for a: 
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1 - 3x ± yj(l+x)(5-3x) 
a±= 2(1^) ' 

yielding two possible solutions a + and a_ from equation fl2"3p. In fig. (El), we have plotted 



the value of the action obtained by solving the remaining stationary conditions for the 
two different values of a and the annealed calculation for the ±1 spin-glass (there is 
only one real solution for U = V) . The curve corresponding to a_ gives defined values 

1 8 

for x between -1 and — ~, and reaches a maximum at x* = —5/7 which value is - In - 

3 ' 2 7 

and corresponds to the value obtained for U ^ V in the previous calculation of the 

total complexity. This solution however always has an action of lower value than that 

coming from the spin glass solution. The solution coming from a + is more pathological. 

Above the value x* = —5/7 the solution corresponding to a + does not exist (this value 

of x* is the value over which U and V obtained from a + become imaginary and so the 

corresponding value of the action S not real). The value of E corresponding to this x* is 

shown by the vertical dotted line on fig.(0). For x < x* the action corresponding to the 

solution with a + is greater than that coming from the spin glass saddle point and hence 

dominates in the thermodynamic limit. One should also note that this action becomes 

equal to zero at E — —3/2 the ground state for the ferromagnet, as it should. Hence 

we see that the energy level with the largest number of metastable states, and thus 

dominating the average total number, occurs at any energy higher than that where the 

difference between the spin glass and ferromagnetic calculations yields different results 

and above this energy level the effect of loops is negligible. However, below x* the 

number of metastable states is larger in the ferromagnet than in the spin glass. In 

addition we shall see that E* is the energy below which the metastable states acquire 

a non-zero global magnetisation. 

We now continue the computation of the number of metastable states of fixed energy 
E but with fixed magnetisation m — jrJ2^i- The average number of metastable states 
of energy E and magnetisation M is then given by 

N MS (E, m) = Tr {[ 9 ( £ J^SiS, j 8{H - NE)6(Nm - £ Si) 

One introduces another Lagrange multiplier h to fix with m. The resulting action is 
now 



Sp(u, v, t, h, a; E, m) 



-- \n(u 2 + t 2 v 2 + 2t) + \n(f(ue- a ) e h + t c f(ve~ a ) e~ h ) 
c 

a(- — E) — mh. 



In (N MS (E,m)) 

— = m&x U:V:tAa b F {u, v, t, h, a; E, m) 
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The stationarity condition with respect to h gives 



f(ue- a )e h -t c f(ve- a )e- h 
m f(ue- a )e h + t c f(ve~ a )e- h ^ ' 

substituting this values for h in the action yields the reduced action 

Sp(u,v,t,a;E,m) = -- ln( M 2 + tV + It) + -±- Hf(ue- a )) + Hf(ve~ a )) 

1 — m, ,c 1+m, ,1 + m. 1 — m, ,1 — m, 

+ c _ blt + a( __ B) __ h( _ ) __ to( _ ) . 

The remaining stationarity conditions are 

2(m + l) , 



U 



1 + x 



y = 2(1 -m) 1 
1 + x 

4 nl ([/-2) 2 (K-2) 2j 
1 U ~ v 2 



For a fixed energy greater than the ground state, the number of metastable states must 
go to zero before m 2 = 1. Indeed, when m + 1 = |(1 + x) and 1 — m = |(l + x), it 
and v are respectively zero, Sp exhibits a singularity hence values of \m\ > — are 
excluded. Now, if we fix the energy and plot the number of metastable states for m 
going from —1 to 1, we get two kinds of configurations: 

• if x > x*, then the maximum is at m = 0, that is the magnetisation is zero ; 

• if x < x*, then the point m = is a local minimum, and there are two local 
maxima of opposite non zero magnetisations. 

These results are demonstrated in the different regimes in fig. (0). The stationarity 
condition on m leads to: 

f(ue~ a ) -t c f(ve~ a ) 

vn = 

f{ue~ a ) +t c f{ye~ a Y 

which leads to a second order transition in the value of m at i*. 

One finds therefore, by comparison at the same energy E with the spin glass, that the 
possibility of a non zero magnetisation paradoxically increases the metastability of the 
system. 
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4 Conclusion 

In conclusion, we have seen that the mean number of metastable states for the Ising 
ferromagnet on thin graphs increases exponentially with the size of the system. More- 
over, for the total average number, the result is the same as the one obtained for the 
corresponding ±J spin glass. The complexity does change in the low energy phase 
where it becomes convex in the case of the ferromagnet. This shows that at high 
energy, the metastability is mainly due to the local geometry of the graphs, and the 
relevance of loops seems not to be significant. At low energy, the presence of some 
non-zero magnetisation for c > 2 seems to be responsible of a complexity bigger than 
the one computed (in an annealed calculation) for the spin glass. 
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Figure 1: Numerical calculation of Sp(E) = In ((Nms(E))) /N of the number of 
metastable states of fixed energy for c = 4 (a). The dashed line (b) is the corre- 
sponding solution for the spin glass. 
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Figure 2: S F (E) = In ((N MS (E)}) /N for c = 3 shown by the solid curve (d). Also 
plotted is the solution corresponding to a_ (a), the corresponding spin glass solution 
in the low energy region (b). The vertical dotted line (c) represents the crossover point 
where the spin glass and ferromagnetic solutions start to differ. 
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Figure 3: SpiE^m) = In ((NMs(E,m))) /N for c = 3 as a function of the mag- 
netisation m for different values of the energy: —0.765 > E* (a), —1.071 = E* (b), 
— 1.245 < E* (c). The arrows indicate the local maximum which gives the dominant 
contribution to Sf(E) at fixed energy. At E ~ E*, the maximum corresponding to 
the spin glass solution splits into two maxima and the Z 2 symmetry is spontaneously 
broken. 



